Validating Simulations
نویسنده
چکیده
Why Read This Chapter? To help you decide how to check your simulation – both against its antecedent conceptual models (verification) and external standards such as data (validation) – and in this way help you to establish the credibility of your simulation. In order to do this the chapter will point out the nature of these processes, including the variety of ways in which people seek to achieve them. Abstract Verification and validation are two important aspects of model building. Verification and validation compare models with observations and descriptions of the problem modelled, which may include other models that have been verified and validated to some level. However, the use of simulation for modelling social complexity is very diverse. Often, verification and validation do not refer to an explicit stage in the simulation development process, but to the modelling process itself, according to good practices and in a way that grants credibility to using the simulation for a specific purpose. One cannot consider verification and validation without considering the purpose of the simulation. This chapter deals with a comprehensive outline of methodological perspectives and practical uses of verification and validation. The problem of verification and validation is tackled in three main topics: (1) the meaning of the terms verification and validation in the context of simulating social complexity; (2) methods and techniques related to verification, including static and dynamic methods, good programming practices, defensive programming, and replication for model alignment; and (3) types and techniques of validation as well as their relationship to different modelling strategies.
منابع مشابه
Validating Evolving Simulations in COERCE
We seek to increase user confidence in simulations as they are adapted to meet new requirements. Our approach includes formal representation of uncertainty, lightweight validation, and novel techniques for exploring emergent behavior. Uncertainty representation, using formalisms such as Dempster-Shafer theory, can capture designer insight about uncertainty, enabling formal analysis and improvin...
متن کاملValidating a Peer-to-Peer Evolutionary Algorithm
This paper proposes a simple experiment for validating a Peer-to-Peer Evolutionary Algorithm in a real computing infrastructure in order to verify that results meet those obtained by simulations. The validation method consists of conducting a well-characterized experiment in a large computer cluster of up to a number of processors equal to the population estimated by the simulator. We argue tha...
متن کاملWind Tunnel Testing of Novel Wing Configurations for Design and Customisation in an Industry 4.0 Environment
Industry 4.0 calls for validated simulations for rapid customization and through-life designs. Wind tunnel experiments are widely used in validating flow-field simulations for aircraft design and manufacture. In this paper, we develop testing for simulating the NACA0015 model wings in various shapes and Angles of Attacks (AoA) through an anatomy wind tunnel. Particle traces are recorded during ...
متن کاملApplication of the SALSSA framework to the validation of smoothed particle hydrodynamics simulations of low Reynolds number flows
The Support Architecture for Large-Scale Subsurface Analysis (SALSSA) provides an extensible framework, sophisticated graphical user interface (GUI), and underlying data management system that simplifies the process of running subsurface models, tracking provenance information, and analyzing the model results. The SALSSA software framework is currently being applied to validating the Smoothed P...
متن کاملDetermination of flow orientation of an optically active turbulent field by means of a single beam.
The cross-flow orientation of an optically active turbulent field was determined by Fourier transforming the wander of a laser beam propagating in the ocean. A simple physical model for the measured effect is offered, and numerical simulations are performed. The simulations are in good agreement with measurements, validating the assumptions made in the model.
متن کاملVerification and Validation of Crowd Simulations
To date no technique for validating crowd control models has been proposed. Usually subject matter experts “look at” the simulations and decide if what they are observing “appears” reasonable or not. One reason for this has been inability to gather quantitative data from either actual crowd footage or simulations of crowds. Since this problem is being solved by Kaup et al, it now becomes possib...
متن کامل